2 links tagged with all of: content moderation + classification + safety
Click any tag below to further narrow down your results
Links
PolicyLM is a 1.7-billion-parameter open-source model that flags policy violations in text by scoring messages against custom rules defined at inference time, without needing retraining. It returns violation scores and threshold-based flags for content moderation across 19 languages.
- Custom policies can be written and applied at inference time without model retraining, making it adaptable to different platform rules on the fly.
- The model scores multiple policy categories in a single pass and is designed for low-latency screening of live chat, comments, and user posts.
- It's released under Apache 2.0 and evaluated on multilingual text, but teams must validate score thresholds on their own data and should only use it for individual messages, not images or conversation context.
Musubi Labs released PolicyLM-1.7B, a small open-source language model designed to make moderation decisions on live messages in under 100ms by reading your platform's actual policies instead of relying on fixed taxonomies. It runs on a single GPU or laptop and lets teams update policies instantly without retraining.
- Processes messages in under 100ms (median 35ms on short chat) while scoring against custom policies, making it viable for live chat where fixed classifiers are blind to policy changes and large LLMs are too slow.
- Reads your policy with every message, so policy edits take effect immediately without retraining or annotation work—useful for teams with frequent rule changes or policies that don't fit standard taxonomies.
- Open weights (Apache 2.0) and already proven in production on a platform handling over a million messages daily; includes two threshold presets (precision-focused for rare violations, balanced for higher detection).